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DETAILED ACTION 

1 . This Office Action is in response to correspondence filed 1 1 December 2009 in 
reference to application 10/542,947. Claims 56-63, and 65-72 are pending and have 
been examined. 

Response to Amendment 

2. The amendment filed 1 1 December 2009 has been accepted and considered in 
this office action. Claims 56-62, and 65-72 have been amended, and claims 55 and 73 
cancelled. 

Response to Arguments 

3. Applicant's arguments with respect to claims 56-63, and 65-72 have been 
considered but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 103 

1 . The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

2. Claims 56 and 65 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Baker (U.S. Pub. No. 2004/0190687), in view of Kivimaki (U.S. Patent No. 
7,174,295 B1) and further in view of Tognazzi (US Patent 5,850,21 1). 
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3. Regarding claims 56 and 65, Baker teaciies a voice output apparatus and 
method comprising: 

a text display unit operable to display a text message which is information to be 
transmitted to a user and a voice output unit operable to output, via a voice message, 
the information to be transmitted (the speech recognition unit performs processing and 
the output of the speech recognition unit is proceeded to the human call center 
operator, preferably by way of text proved on a display and at the same time (or just 
before or after the text is provided on the display) the caller's recorded utterances are 
audibly provided to the human call center operator, (Paragraph 44)); 

However, Baker fails to teach a voice output apparatus and method comprising a 
delay determination unit operable to determine a delay time according to a form of the 
text message displayed by said text display unit wherein a voice output unit operable to 
output, via voice message, the information to be transmitted, when the delay time 
determined by said delay determination unit passes after the text message is displayed 
by said display unit. 

Kivimaki teaches, in analogous art, the concept of inserting a delay into a text to 
speech system wherein the delay can be varied in dependence on the number of words 
and characters in a text group (Column 6 lines 9-14 and lines 47-52) The delay of 
Kivimaki meets the two requirements of the claims; requirement 1) because even if the 
delay is based on processing speed of the text to speech conversion, this will be 
affected by the number of words that are displayed, which is part of the form. It is not 
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specifically stated how the delay time in requirement 2) is determined and therefore this 
requirement is non-functional descriptive language. Given this interpretation, A delay 
based on processing times, as the applicant has stated as the teaching of Kivimaki, 
could in fact be equal to a time necessary for a user to visually identify the message, 
meeting the requirement of the claim. 

Therefore, it would have been obvious to a person of ordinary skill in the art at 
the time the invention was made to further include the concept of varied delay disclosed 
in Kivimaki with the voice output apparatus disclosed in Baker in order to make the 
system more user friendly by allowing the user to read the entire text message without 
interruption. More specifically, the delay would control the time period "just after" the 
text provided on the screen is displayed at which time the "caller's recorded utterances 
are audibly provided" and the display mode corresponds to the length of the text 
displayed. While the examiner understands that Kivimaki outputs the voice in "blocks," 
it is noted that all of these blocks occurs after the first delay, and therefore meets the 
requirement that the entire representation be outputted only after the delay. 

Baker and Kivimaki do not teach: 

wherein said delay determination unit: determines that the delay time should be 
short in a case where a size of characters in the text message displayed by said text 
display unit is large; and 

determines that the delay time should be long in a case where the size of the 
characters is small. 
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In the same field of computer control, Tognazzi suggests wherein said delay 
determination unit: determines that the delay time should be short in a case where a 
size of characters in the text message displayed by said text display unit is large; and 
determines that the delay time should be long in a case where the size of the characters 
is small (Column 2 line 15 - column 3 line 15, functions of a computer, particularly 
scrolling is controllable as a function of eye gaze. Clearly the size of a text would affect 
how long it took a user to "find" a text, and therefore affect eye gaze.) 

Therefore it would have been obvious to one of ordinary skill In the art to control 
the determination unit of Baker and Kivimaki witch an eye gaze input as taught by 
Tagnazzi in order to allow for control of the computer requiring no overt actions by the 
user (Tagnazzi column 2 line 25). 

4. Regarding claims 57 and 66, Baker teaches a voice output apparatus and 
method comprising: 

a text display unit operable to display a text message which is information to be 
transmitted to a user and a voice output unit operable to output, via a voice message, 
the information to be transmitted (the speech recognition unit performs processing and 
the output of the speech recognition unit is proceeded to the human call center 
operator, preferably by way of text proved on a display and at the same time (or just 
before or after the text is provided on the display) the caller's recorded utterances are 
audibly provided to the human call center operator, (Paragraph 44)); 
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However, Baker fails to teach a voice output apparatus and method comprising a 
delay determination unit operable to determine a delay time according to a form of the 
text message displayed by said text display unit wherein a voice output unit operable to 
output, via voice message, the information to be transmitted, when the delay time 
determined by said delay determination unit passes after the text message is displayed 
by said display unit. 

Kivimaki teaches, in analogous art, the concept of inserting a delay into a text to 
speech system wherein the delay can be varied in dependence on the number of words 
and characters in a text group (Column 6 lines 9-14 and lines 47-52) The delay of 
Kivimaki meets the two requirements of the claims; requirement 1) because even if the 
delay is based on processing speed of the text to speech conversion, this will be 
affected by the number of words that are displayed, which is part of the form. It is not 
specifically stated how the delay time in requirement 2) is determined and therefore this 
requirement is non-functional descriptive language. Given this interpretation, A delay 
based on processing times, as the applicant has stated as the teaching of Kivimaki, 
could in fact be equal to a time necessary for a user to visually identify the message, 
meeting the requirement of the claim. 

Therefore, it would have been obvious to a person of ordinary skill in the art at 
the time the invention was made to further include the concept of varied delay disclosed 
in Kivimaki with the voice output apparatus disclosed in Baker in order to make the 
system more user friendly by allowing the user to read the entire text message without 
interruption. More specifically, the delay would control the time period "just after" the 
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text provided on the screen is displayed at whicli time tlie "caller's recorded utterances 
are audibly provided" and the display mode corresponds to the length of the text 
displayed. While the examiner understands that Kivimaki outputs the voice in "blocks," 
it is noted that all of these blocks occurs after the first delay, and therefore meets the 
requirement that the entire representation be outputted only after the delay. 
Baker and Kivimaki do not teach: 

wherein said delay determination unit: determines that the delay time should be 
long in a case where a distance between a focal point and characters in the text 
message displayed by said text display unit is long, the focal point being set on said text 
display unit for attracting the user's attention; and determines that the delay time should 
be short in a case where the distance is short. 

In the same field of computer control, Tognazzi suggests wherein said delay 
determination unit: determines that the delay time should be long in a case where a 
distance between a focal point and characters in the text message displayed by said 
text display unit is long, the focal point being set on said text display unit for attracting 
the user's attention; and determines that the delay time should be short in a case where 
the distance is short. (Column 2 line 1 5 - column 3 line 1 5, functions of a computer, 
particularly scrolling is controllable as a function of eye gaze. Clearly a focal point 
would affect how long it took a user to "find" a text, and therefore affect eye gaze.) 

Therefore it would have been obvious to one of ordinary skill In the art to control 
the determination unit of Baker and Kivimaki witch an eye gaze input as taught by 
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Tagnazzi in order to allow for control of the computer requiring no overt actions by the 
user (Tagnazzi column 2 line 25). 

5. Regarding claims 58 and 67, Baker teaches a voice output apparatus and 

method comprising: 

a text display unit operable to display a text message which is information to be 
transmitted to a user and a voice output unit operable to output, via a voice message, 
the information to be transmitted (the speech recognition unit performs processing and 
the output of the speech recognition unit is proceeded to the human call center 
operator, preferably by way of text proved on a display and at the same time (or just 
before or after the text is provided on the display) the caller's recorded utterances are 
audibly provided to the human call center operator, (Paragraph 44)); 

However, Baker falls to teach a voice output apparatus and method comprising a 
delay determination unit operable to determine a delay time according to a form of the 
text message displayed by said text display unit wherein a voice output unit operable to 
output, via voice message, the information to be transmitted, when the delay time 
determined by said delay determination unit passes after the text message is displayed 
by said display unit. 

KlvlmakI teaches, in analogous art, the concept of inserting a delay Into a text to 
speech system wherein the delay can be varied in dependence on the number of words 
and characters in a text group (Column 6 lines 9-14 and lines 47-52) The delay of 
Kivimaki meets the two requirements of the claims; requirement 1) because even if the 
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delay is based on processing speed of the text to speecli conversion, this will be 
affected by the number of words that are displayed, which is part of the form. It is not 
specifically stated how the delay time in requirement 2) is determined and therefore this 
requirement is non-functional descriptive language. Given this interpretation, A delay 
based on processing times, as the applicant has stated as the teaching of Kivimaki, 
could in fact be equal to a time necessary for a user to visually identify the message, 
meeting the requirement of the claim. 

Therefore, it would have been obvious to a person of ordinary skill in the art at 
the time the invention was made to further include the concept of varied delay disclosed 
in Kivimaki with the voice output apparatus disclosed in Baker in order to make the 
system more user friendly by allowing the user to read the entire text message without 
interruption. More specifically, the delay would control the time period "just after" the 
text provided on the screen is displayed at which time the "caller's recorded utterances 
are audibly provided" and the display mode corresponds to the length of the text 
displayed. While the examiner understands that Kivimaki outputs the voice in "blocks," 
it is noted that all of these blocks occurs after the first delay, and therefore meets the 
requirement that the entire representation be outputted only after the delay. 

Baker and Kivimaki do not teach: 

wherein said delay time determination unit: determines that the delay time should 
be short in the a case where a contrast between a color at a position on said text 
display unit and a color of characters in the text message is large, such that the user's 
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attention is drawn to the position on said text display unit as a result of the contrast; and 
determines that the delay time should be long in a case where the contrast is small. 

In the same field of computer control, Tognazzi suggests wherein said delay time 
determination unit: determines that the delay time should be short in the a case where a 
contrast between a color at a position on said text display unit and a color of characters 
in the text message is large, such that the user's attention is drawn to the position on 
said text display unit as a result of the contrast; and determines that the delay time 
should be long in a case where the contrast is small.. (Column 2 line 15 - column 3 line 
15, functions of a computer, particularly scrolling is controllable as a function of eye 
gaze. Clearly a color contrast would affect how long it took a user to "find" a text, and 
therefore affect eye gaze.) 

Therefore it would have been obvious to one of ordinary skill In the art to control 
the determination unit of Baker and Kivimaki witch an eye gaze input as taught by 
Tagnazzi in order to allow for control of the computer requiring no overt actions by the 
user (Tagnazzi column 2 line 25). 

6. Regarding claims 59 and 68 Baker teaches a voice output apparatus and method 

comprising: 

a text display unit operable to display a text message which is information to be 
transmitted to a user and a voice output unit operable to output, via a voice message, 
the information to be transmitted (the speech recognition unit performs processing and 
the output of the speech recognition unit is proceeded to the human call center 
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operator, preferably by way of text proved on a display and at the same time (or just 
before or after the text is provided on the display) the caller's recorded utterances are 
audibly provided to the human call center operator, (Paragraph 44)); 

However, Baker fails to teach a voice output apparatus and method comprising a 
delay determination unit operable to determine a delay time according to a form of the 
text message displayed by said text display unit wherein a voice output unit operable to 
output, via voice message, the information to be transmitted, when the delay time 
determined by said delay determination unit passes after the text message is displayed 
by said display unit. 

Kivimaki teaches, in analogous art, the concept of inserting a delay into a text to 
speech system wherein the delay can be varied in dependence on the number of words 
and characters in a text group (Column 6 lines 9-14 and lines 47-52) The delay of 
Kivimaki meets the two requirements of the claims; requirement 1) because even if the 
delay is based on processing speed of the text to speech conversion, this will be 
affected by the number of words that are displayed, which is part of the form. It is not 
specifically stated how the delay time in requirement 2) is determined and therefore this 
requirement is non-functional descriptive language. Given this interpretation, A delay 
based on processing times, as the applicant has stated as the teaching of Kivimaki, 
could in fact be equal to a time necessary for a user to visually identify the message, 
meeting the requirement of the claim. 

Therefore, it would have been obvious to a person of ordinary skill in the art at 
the time the invention was made to further include the concept of varied delay disclosed 
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in Kivimaki with the voice output apparatus disclosed in Baker in order to make the 
system more user friendly by allowing the user to read the entire text message without 
interruption. More specifically, the delay would control the time period "just after" the 
text provided on the screen is displayed at which time the "caller's recorded utterances 
are audibly provided" and the display mode corresponds to the length of the text 
displayed. While the examiner understands that Kivimaki outputs the voice in "blocks," 
it is noted that all of these blocks occurs after the first delay, and therefore meets the 
requirement that the entire representation be outputted only after the delay. 
Baker and Kivimaki do not teach: 

wherein said delay determination unit: determines that the delay time should be 
short in a case where a degree of flashing characters in the text message displayed by 
the text display unit is high; and determines that the delay time should be long in a case 
where the degree of flashing is low. 

In the same field of computer control, Tognazzi suggests wherein said delay 
determination unit: determines that the delay time should be short in a case where a 
degree of flashing characters in the text message displayed by the text display unit is 
high; and determines that the delay time should be long in a case where the degree of 
flashing is low. (Column 2 line 1 5 - column 3 line 1 5, functions of a computer, 
particularly scrolling is controllable as a function of eye gaze. Clearly flashing would 
affect how long it took a user to "find" a text, and therefore affect eye gaze.) 

Therefore it would have been obvious to one of ordinary skill In the art to control 
the determination unit of Baker and Kivimaki witch an eye gaze input as taught by 
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Tagnazzi in order to allow for control of the computer requiring no overt actions by the 
user (Tagnazzi column 2 line 25). 

7. Regarding claims 60 and 69 Baker teaches a voice output apparatus and method 

comprising: 

a text display unit operable to display a text message which is information to be 
transmitted to a user and a voice output unit operable to output, via a voice message, 
the information to be transmitted (the speech recognition unit performs processing and 
the output of the speech recognition unit is proceeded to the human call center 
operator, preferably by way of text proved on a display and at the same time (or just 
before or after the text is provided on the display) the caller's recorded utterances are 
audibly provided to the human call center operator, (Paragraph 44)); 

However, Baker fails to teach a voice output apparatus and method comprising a 
delay determination unit operable to determine a delay time according to a form of the 
text message displayed by said text display unit wherein a voice output unit operable to 
output, via voice message, the information to be transmitted, when the delay time 
determined by said delay determination unit passes after the text message is displayed 
by said display unit. 

Kivimaki teaches, in analogous art, the concept of inserting a delay into a text to 
speech system wherein the delay can be varied in dependence on the number of words 
and characters in a text group (Column 6 lines 9-14 and lines 47-52) The delay of 
Kivimaki meets the two requirements of the claims; requirement 1) because even if the 
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delay is based on processing speed of the text to speecli conversion, this will be 
affected by the number of words that are displayed, which is part of the form. It is not 
specifically stated how the delay time in requirement 2) is determined and therefore this 
requirement is non-functional descriptive language. Given this interpretation, A delay 
based on processing times, as the applicant has stated as the teaching of Kivimaki, 
could in fact be equal to a time necessary for a user to visually identify the message, 
meeting the requirement of the claim. 

Therefore, it would have been obvious to a person of ordinary skill in the art at 
the time the invention was made to further include the concept of varied delay disclosed 
in Kivimaki with the voice output apparatus disclosed in Baker in order to make the 
system more user friendly by allowing the user to read the entire text message without 
interruption. More specifically, the delay would control the time period "just after" the 
text provided on the screen is displayed at which time the "caller's recorded utterances 
are audibly provided" and the display mode corresponds to the length of the text 
displayed. While the examiner understands that Kivimaki outputs the voice in "blocks," 
it is noted that all of these blocks occurs after the first delay, and therefore meets the 
requirement that the entire representation be outputted only after the delay. 

Baker and Kivimaki do not teach: 

a personal information obtainment that obtains an age of the user, 

wherein said delay determination unit: determines that the delay time should be 

long in a case where the obtained age is high; and determines that the delay time 

should be short in a case where the obtained age is low. 
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In the same field of computer control, Tognazzi suggests a personal information 
obtainment that obtains an age of the user, wherein said delay determination unit: 
determines that the delay time should be long in a case where the obtained age is high; 
and determines that the delay time should be short in a case where the obtained age is 
low. (Column 2 line 15 - column 3 line 15, functions of a computer, particularly scrolling 
is controllable as a function of eye gaze. Clearly age would affect how long it took a 
user to "find" a text, and therefore affect eye gaze) 

Therefore it would have been obvious to one of ordinary skill In the art to control 
the determination unit of Baker and Kivimaki witch an eye gaze input as taught by 
Tagnazzi in order to allow for control of the computer requiring no overt actions by the 
user (Tagnazzi column 2 line 25). 

8. Regarding claims 61 and 70 Baker teaches a voice output apparatus and method 

comprising: 

a text display unit operable to display a text message which is information to be 
transmitted to a user and a voice output unit operable to output, via a voice message, 
the information to be transmitted (the speech recognition unit performs processing and 
the output of the speech recognition unit is proceeded to the human call center 
operator, preferably by way of text proved on a display and at the same time (or just 
before or after the text is provided on the display) the caller's recorded utterances are 
audibly provided to the human call center operator, (Paragraph 44)); 
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However, Baker fails to teach a voice output apparatus and method comprising a 
delay determination unit operable to determine a delay time according to a form of the 
text message displayed by said text display unit wherein a voice output unit operable to 
output, via voice message, the information to be transmitted, when the delay time 
determined by said delay determination unit passes after the text message is displayed 
by said display unit. 

Kivimaki teaches, in analogous art, the concept of inserting a delay into a text to 
speech system wherein the delay can be varied in dependence on the number of words 
and characters in a text group (Column 6 lines 9-14 and lines 47-52) The delay of 
Kivimaki meets the two requirements of the claims; requirement 1) because even if the 
delay is based on processing speed of the text to speech conversion, this will be 
affected by the number of words that are displayed, which is part of the form. It is not 
specifically stated how the delay time in requirement 2) is determined and therefore this 
requirement is non-functional descriptive language. Given this interpretation, A delay 
based on processing times, as the applicant has stated as the teaching of Kivimaki, 
could in fact be equal to a time necessary for a user to visually identify the message, 
meeting the requirement of the claim. 

Therefore, it would have been obvious to a person of ordinary skill in the art at 
the time the invention was made to further include the concept of varied delay disclosed 
in Kivimaki with the voice output apparatus disclosed in Baker in order to make the 
system more user friendly by allowing the user to read the entire text message without 
interruption. More specifically, the delay would control the time period "just after" the 
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text provided on the screen is displayed at whicli time tlie "caller's recorded utterances 
are audibly provided" and the display mode corresponds to the length of the text 
displayed. While the examiner understands that Kivimaki outputs the voice in "blocks," 
it is noted that all of these blocks occurs after the first delay, and therefore meets the 
requirement that the entire representation be outputted only after the delay. 
Baker and Kivimaki do not teach: 

a habituation specifying unit that obtains a number of times the user operates 
said voice output apparatus, wherein said delay determination unit: determines that the 
delay time should be short in the a case where the obtained number of operations is 
large; and determines that the delay time should be long in a case where the obtained 
number of operations is small. 

In the same field of computer control, Tognazzi suggests a habituation specifying 
unit that obtains a number of times the user operates said voice output apparatus, 
wherein said delay determination unit: determines that the delay time should be short in 
the a case where the obtained number of operations is large; and determines that the 
delay time should be long in a case where the obtained number of operations is small. 

(Column 2 line 15 -column 3 line 15, functions of a computer, particularly 
scrolling is controllable as a function of eye gaze. Clearly habbits would affect how long 
it took a user to "find" a text, and therefore affect eye gaze) 

Therefore it would have been obvious to one of ordinary skill In the art to control 
the determination unit of Baker and Kivimaki witch an eye gaze input as taught by 
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Tagnazzi in order to allow for control of the computer requiring no overt actions by the 
user (Tagnazzi column 2 line 25). 

9. Regarding claims 62 and 71 Baker teaches a voice output apparatus and method 

comprising: 

a text display unit operable to display a text message which is information to be 
transmitted to a user and a voice output unit operable to output, via a voice message, 
the information to be transmitted (the speech recognition unit performs processing and 
the output of the speech recognition unit is proceeded to the human call center 
operator, preferably by way of text proved on a display and at the same time (or just 
before or after the text is provided on the display) the caller's recorded utterances are 
audibly provided to the human call center operator, (Paragraph 44)); 

However, Baker fails to teach a voice output apparatus and method comprising a 
delay determination unit operable to determine a delay time according to a form of the 
text message displayed by said text display unit wherein a voice output unit operable to 
output, via voice message, the information to be transmitted, when the delay time 
determined by said delay determination unit passes after the text message is displayed 
by said display unit. 

Kivimaki teaches, in analogous art, the concept of inserting a delay into a text to 
speech system wherein the delay can be varied in dependence on the number of words 
and characters in a text group (Column 6 lines 9-14 and lines 47-52) The delay of 
Kivimaki meets the two requirements of the claims; requirement 1) because even if the 
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delay is based on processing speed of the text to speecli conversion, this will be 
affected by the number of words that are displayed, which is part of the form. It is not 
specifically stated how the delay time in requirement 2) is determined and therefore this 
requirement is non-functional descriptive language. Given this interpretation, A delay 
based on processing times, as the applicant has stated as the teaching of Kivimaki, 
could in fact be equal to a time necessary for a user to visually identify the message, 
meeting the requirement of the claim. 

Therefore, it would have been obvious to a person of ordinary skill in the art at 
the time the invention was made to further include the concept of varied delay disclosed 
in Kivimaki with the voice output apparatus disclosed in Baker in order to make the 
system more user friendly by allowing the user to read the entire text message without 
interruption. More specifically, the delay would control the time period "just after" the 
text provided on the screen is displayed at which time the "caller's recorded utterances 
are audibly provided" and the display mode corresponds to the length of the text 
displayed. While the examiner understands that Kivimaki outputs the voice in "blocks," 
it is noted that all of these blocks occurs after the first delay, and therefore meets the 
requirement that the entire representation be outputted only after the delay. 

Baker and Kivimaki do not teach: 

a habituation specifying unit that obtains an operation time during which the user 
operates said voice output apparatus, wherein said delay determination unit: determines 
that the delay time should be short in the a case where the obtained operation time is 
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long; and determines that the delay time should be long in a case where the obtained 
operation time is short.. 

In the same field of computer control, Tognazzi suggests a habituation specifying 
unit that obtains an operation time during which the user operates said voice output 
apparatus, wherein said delay determination unit: determines that the delay time should 
be short in the a case where the obtained operation time is long; and determines that 
the delay time should be long in a case where the obtained operation time is short 
(Column 2 line 15 - column 3 line 15, functions of a computer, particularly scrolling is 
controllable as a function of eye gaze. Clearly habbits would affect how long it took a 
user to "find" a text, and therefore affect eye gaze). 

Therefore it would have been obvious to one of ordinary skill In the art to control 
the determination unit of Baker and Kivimaki witch an eye gaze input as taught by 
Tagnazzi in order to allow for control of the computer requiring no overt actions by the 
user (Tagnazzi column 2 line 25). 

1 0. Regarding claims 63 and 72, Baker in view of Kivimaki teaches the limitations of 
claims 57 and 66. Brackett further teaches a voice output apparatus and method 
wherein said text display unit is operable to display an agent as the focal point (a 
display could also give an alarm wherein the alarm may be by way of a visual signal 
such as an icon (Column 5 lines 30-41). 
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Conclusion 

Any inquiry concerning this communication or earlier communications from tine 
examiner should be directed to DOUGLAS C. GODBOLD whose telephone number is 
(571)270-1451 . The examiner can normally be reached on Monday-Thursday 7:00am- 
4:30pm Friday 7:00am-3:30pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on (571) 272-7602. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

DCG 

/Richemond Dorvil/ 

Supervisory Patent Examiner, Art Unit 2626 



